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Abstract 


The purpose of this study is to present the relations between organizational effectiveness and efficiency 
in public sector units. The study was conducted in 114 Polish communes, in the period from January to 
June 2013. To assess organizational effectiveness the author s model has been applied, which considers 
criteria referring to the three main concepts of management in the public sector: the traditional public 
administration, New Public Management and Public Governance. The efficiency assessment was based 
on the method of DEA (Data Envelopment Analysis). To study the relations between the organizational 
effectiveness and the efficiency Spearman’ rank correlation method and the Wilcoxon signed-rank test 
have been used. 

Key words: organizational effectiveness, efficiency, DEA (Data Envelopment Analysis), public sector 
units. 


Introduction 


The public sector is present in each country regardless of its socio-political structure 
or economic development. The state fulfils its basic functions through the public sector, and 
delivers public goods which, due to their nature or unprofitability cannot be provided by 
the private sector. Delivering public goods and maintaining public sectors by contemporary 
countries involves increasing costs. As a result, questions about the efficiency and effectiveness 
of the public sector are raised more and more often. This problem 1s also reflected in increasing 
scientific research. Research undertaken in this respect are most often related to the evaluation 
of the efficiency of the entire public sector. It usually consists in searching for correlations 
between expenses in the public sector and various measures of economic growth. However, 
it should be emphasized that the public sector consists of thousands of organizational units 
the performance of which does not depend only on system conditions but also on the level of 
management at single units. 

Scientific research concerning the efficiency at the level of single public units 1s 
conducted much less frequently. Most often, it consists in the assessment of the examined units 
on the basis of selected indicators or by applying the stochastic frontier methods. The former 
approach refers to the assessment of efficiency of services or certain areas of public activity 
in the examined units. The latter is associated with the comprehensive assessment of the unit 
from the perspective of technical efficiency. The main method in this respect is DEA (Data 
Envelopment Analysis). Both the indicator methods and the stochastic frontier methods consist 
in relative analysis - the comparison between various public units. In the case of indicator 
methods, this comparison is direct, while in the case of stochastic frontier methods - it applies 
to a curve, determining the level of “model” efficiency in the set of examined units. However, 
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these methods do not provide knowledge about the reasons for a specific level of performance, 
in particular related to quality and efficiency of management in the examined units. 

Such identification is possible by the assessment of organizational effectiveness. This 
category does not have a precise definition. It is most often presented in the form of multi- 
dimensional criteria which make it possible to identify various types of outputs and indicate 
reasons for a specific level of performance in a given organizational system. 

Examining relations between the discussed categories of assessment of the outputs of 
public units will consist of an analysis of the correlation between the criteria of organizational 
effectiveness and efficiency in selected units. The implementation of this objective requires, 
first of all, the development of a model of organizational effectiveness taking into account the 
special character of management in public sector units. Research concerning the discussed 
problem has been conducted in 114 randomly selected communes. These units constitute the 
basic and, at the same time, the most numerous group of public institutions in Poland. The main 
premise for selecting this type of units was: comparability resulting from identical principles 
and objectives of their actions and observed differences in the level of comprehensive efficiency 
occurring between these units. The second criterion of selection was the unit’s size. The research 
was conducted in units employing more than 50 employees. This limitation resulted directly 
from the assumption that in the case of large units management requires the formation of a 
specific system and using a set of principles and tools in a formalized manner. The research was 
conducted in the period from January to June 2013. 


Methodology of Research 
Methodology of Efficiency 


Efficiency is one of the basic categories of assessing actions. It 1s expressed in the form 
of the relationship between outputs and inputs used to obtain them. It is most often assessed on 
the basis of various indicators which are examined separately or jointly after their aggregation. 
The stochastic frontier methods are recently used more and more often in the assessment of the 
efficiency of organizational units. The basis for analysis 1n this case is the determination of the 
production function with the use of classic econometrics estimation tools. The measurement 
of efficiency consists in determining the deviations of particular units from the determined 
function. Stochastic frontier methods enable a comprehensive, relative (by comparison with 
others) assessment of the efficiency of the examined units. Additionally, in the case of these 
methods, as opposed to indicators, the outputs and inputs do not need to be expressed in the 
form of financial values. Stochastic frontier methods are divided into: parametric and non- 
parametric. Parametric methods most often used in the assessment of efficiency include: COLS 
(Corrected Ordinary Least Squares), FPF (Frontier Production Function), TFA (Thick Frontier 
Approach), SFA (Stochastic Frontier Approach). On the other hand, non-parametric methods 
include: DEA (Data Envelopment Analysis) and FDH (Free Disposal Hull). Parametric meth- 
ods make it possible to analyse efficiency only in the relations of single outputs and inputs. The 
total assessment of the relations of numerous outputs and inputs is possible by the application 
of non-parametric methods. The basic non-parametric method to measure efficiency is DEA 
(Data Envelopment Analysis). In general, it is also the most often applied method for examining 
technical efficiency. 

This method was developed at the end of the 1970s. Its authors are A. Charnes, W. W. 
Cooper and E. Rhodes (1978). The DEA model may be mathematically presented as the follow- 
ing relation (Baran, 2009): 
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where: 
Ei technical (technological) efficiency, 

s —number of effects, 

m — number of inputs, 

u — weights determining the significance of particular effects, 

v.— weights determining the significance of particular inputs, 

aa size of effect of r kind (r = 1, ..., R) inj object, 

Xx. size of input of 7 kind (n= 1, ..., NV) inj object; 7 = 1, ..., J). 

Information necessary to determine efficiency in the DEA method includes (Guzik, 
2009): 

— set of objects O, ..., O; 

—y,,— size of effect of r kind (7 = I, ..., R) inj object, 

—X size of input of 7 kind (n = 1, ..., N) inj object; G = 1, ..., J). 

In the article, the DEA method has been used to assess the efficiency of the examined 
communes. The following has been adopted as categories of outputs: 

— own income of commune per | inhabitant, 

— investment expenses of commune per | inhabitant, 

— investment expenses on municipal economy and environmental protection per | 1n- 
habitant, 

— obtained European funds per | inhabitant, 

— business entities registered in the REGON register per 1 000 inhabitants. 

Inputs have been assessed on the basis of expenses on public administration per | inhab- 
itant. Constant effect of scale has been assumed in the analysis. Indexes used in the study are 
one of the most often used in assessing the activity of communes in Poland. 

The analysis from the perspective of input-oriented efficiency (EI) and output-oriented 
efficiency (EO) has been separately conducted in the research. The former indicates to what 
extent inputs may be reduced without affecting the level of obtained outputs. This degree de- 
fines the distance from the frontier of production capacity determined in this manner. The latter 
category demonstrates how much outputs may be increased at the current inputs. Conducting 
the assessment from the perspective of both categories of efficiency is associated with the fact 
that public sector units may affect both the level of inputs and outputs when maximizing their 
efficiency. 


Methodology of Organizational Effectiveness 


Organizational effectiveness is, on the other hand, a broad category of assessing the 
outputs of cooperation as part of the organizational system. Research concerning the organiza- 
tional effectiveness was conducted mainly in Anglo-Saxon countries. The leading researchers 
from this field include: P.R. Lawrence, W. Lorsch, E. Yuchtman, S. E. Seashore, J.L. Price, D. 
Lawless, R.M. Steers, J.P. Campbell, W.R. Scott, R.E. Quinn, K.S. Cameron, A. Lewin, J.W. 
Minton (Cameron, 2010). 

Organizational effectiveness 1s usually presented in the form of multi-dimensional crite- 
ria relating to the organization’s various attributes. 

One of the first attempts to indicate the criteria defining the essence of organizational 
effectiveness was undertaken by J.P. Campbell. His model covers 30 criteria. These include: 
overall effectiveness, productivity, efficiency, profit, quality, accidents, growth, absenteeism, 
turnover, job satisfaction, motivation, morale, control, conflict / cohesion, flexibility / adapta- 
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tion, planning and goal setting, goal consensus, internalization of organizational goals, role 
and norm congruence, managerial interpersonal skills, managerial task skills, information man- 
agement and communication, readiness, utilization of environment, evaluations by external 
entities, stability, value of human resources, participation and shared influence, training and 
development emphasis, achievement emphasis (Campbell, 1979). Campbell’s model is one of 
the most often quoted perspectives of organizational effectiveness in global literature. 

The assessment of organizational effectiveness of public sector units requires the devel- 
opment of a model the criteria of which would correspond to the specific nature of management 
in this area. 

The specific character of management in public units was changed along with the evolu- 
tion of the public sector’s role in the country. According to H. Izdebski (2007) we may distin- 
guish three basic stages of development in this respect and corresponding management con- 
cepts: traditional public administration, New Public Management, Public Governance. 

The first concept is related to the main stage of public administration’s development. 
During that time, the main idea of public administration became public service. Management 
in the public sector in this period was related to two concepts — the separation of politics and 
administration (W. Wilson) and the ideal bureaucracy (M. Weber). Its presence in the public 
administration sector contributed to the ordering of the principles of operation, the transparency 
of functioning, the formalization of actions, the official hierarchy, the continuity of operation, 
specialization, the maintenance of discipline, filling positions according to work competence- 
based requirements, the impartiality of the officials’ actions. 

The second stage of the public sector’s evolution is New Public Management. The basis 
of this stage is the usage of the principles and methods typical for the private sector in the man- 
agement of public sector units. Changes in the public sector units introduced within this trend 
include: decentralization and disaggregation of units, employment reduction, focus on results, 
implementation of performance management, improving the quality of services, costs reduc- 
tion, raising economic effectiveness and the efficiency of operation. 

The New Public Management model was also quite widely criticized, despite the fact 
that it contributed to numerous positive changes in the functioning of the public sector world- 
wide. The main accusation from the opponents of this concept was the assumption of the pos- 
sibility of transferring management principles and tools used in the private sector to the public 
sector. In the opinion of numerous researchers, the nature of public activities and the specific 
character of processes implemented as part of it makes such transfer impossible (Flynn, 2002; 
Painter, 1997). It has been indicated that administration, as a principle, operates slower than 
private companies because it needs to take into account much more factors 1n its activities. Ad- 
ministrative decisions are often long-term and are a result of political influence (Pollitt, 1990; 
Armstrong, 1998). 

The last stage of the public sector’s development is Public Governance. The beginnings 
of this approach date back to the middle of the 1990s. The basic assumption of Public Govern- 
ance is the incorporation of citizens into the process of governance, on the basis of a partner- 
ship. Hard law, being the sum of regulations, more and more often becomes insufficient for 
good governance and needs to be supplemented with soft law (standards) which will regulate 
public activity (Hausner, 2008). 

The model of organizational effectiveness should thus include criteria referring to all 
three concepts (Figure 1). The criteria of organizational effectiveness in the proposed model 
result from the confrontation of assumptions of management in public sector units and the pre- 
vious achievements with regard to organizational effectiveness. 

In the case of the concept of traditional public administration, the main criteria of or- 
ganizational effectiveness included: stability, control and competency. The stability of exam- 
ined units has been assessed on the basis of the level of variability (S,) and formalization of 
implemented tasks (S,). The effectiveness of control has been assessed through the scope of 
output control (C,). Competency, on the other hand, was examined in two dimensions: from the 
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perspective of the organizational unit and employees. In the first case, it has been evaluated on 
the basis of the compliance of implemented tasks with the formal scope (Co,). In the second 
case, on the other hand, through the compliance with employee competences and the working 
post’s profile (Co,) as well as through the level of expenses for training courses and other forms 
of supplementary education for employees (Co, ). 

Organizational effectiveness of New Public Management has been evaluated through: 
performance, optimization of resource use and motivation. Performance was assessed on the 
basis of two indexes: own incomes of the commune per | inhabitant (P,) and investment ex- 
penses of the commune per | inhabitant (P,). The assessment of the optimization of resource 
use was conducted on the basis of a study of opinions concerning the possibility to increase the 
scope of implemented tasks at the current resource level (O,). Motivation, on the other hand, 
has been assessed through the use of financial bonuses (M,) and promoting individual results 
related to the assessment (M.). 





Criteria of organizational 
effectiveness of the public 
sector units 
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Figure 1: The criteria of organizational effectiveness corresponding to the spe- 
cific nature of management in public sector units. 


With regard to participatory management (Public Governance), the following criteria of 
organizational effectiveness have been used: civil participation, external cooperation and inno- 
vativeness. The level of civil participation has been assessed on the basis of a 5-grade participa- 
tion ladder (Cp,) (Diugosz & Wygnanski, 2005). The scope of external cooperation has been 
assessed through the number of projects implemented in the form of public-private partnership 
(PPP) (Ec,). The basis for assessing innovativeness was the number of functional, subjective 
and organizational innovations implemented by the unit over the past 5 years (1). 

Empirical material was collected on the basis of interviews and the analysis of periodical 
reports from the activities of examined units. A 5-level Likert scale was used to examine the 
opinions of respondents. 


Methodology of Assessment of the Relation between Organizational 
Effectiveness and Efficiency 


Spearman’s rank correlation method and Wilcoxon signed-rank test were used to assess 
the relations between organizational effectiveness and efficiency. The selection of the listed 
methods was determined by the character of the analysed data. With regard to organizational 
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effectiveness factors assessed on the basis of the study of respondent opinions according to 
the 5-level Likert scale, the assessment of relations with regard to comprehensive effective- 
ness has been conducted with the use of both methods. In the case of factors assessed through 
the number of units using a given solution or the number of results in the unit, it was possible 
to apply only the Wilcoxon test. 

Spearman’s rank correlation method may assume values from -1 to 1. These values are 
most often interpreted as follows: 

| I. | < 0.2 - vague correlation, 

0.2 < |r, | < 0.4 - moderate correlation, 
0.4 < |r| < 0.7 - strong correlation, 

| I. | > 0.7 - very strong correlation. 

The correlation’s direction is also significant. Positive correlation means that the values 
of both features change in the same direction. In negative correlation the growth in value of 
one feature corresponds to the decrease in the other. 

Wilcoxon’s test is, on the other hand, a non-parametric alternative of the paired Stu- 
dent’s t-test, when the assumption about the normality of the observation’s difference distribu- 
tion is not met. The value p determined in the test means the probability of rejecting the zero 
hypothesis with the identity of distribution of the compared variables. The standard level of 
significance equal to a = 0.05 has been adopted in the analysis (Aczel, 2011). 








Results of Research and Discussion 


The conducted analysis in most cases did not demonstrate the presence of a strong corre- 
lation between the criteria related to organizational effectiveness and comprehensive efficiency 
considered from the perspective of inputs and outputs. To a great extent this results from the 
properties of the analysed variables. In this case they are mainly characterized by a high degree 
of variability and do not form a simple cause and effect system. In such a situation correlations 
even at a low level may be the basis for deduction on defined tendencies. As it has been men- 
tioned above, the correlation’s direction is also significant. 

The results of analyses of the discussed dependences have been presented in Table 1. 

In the case of criteria of organizational effectiveness related to traditional public admin- 
istration the highest level of positive correlation occurred between expenses on supplementary 
education for employees (Co,) as well as the compliance between employee competences and 
the working post’s profile (Co,) and the efficiency of inputs (EN) (7, = 0.22; p = 0.021 and r, 
= 0.17; p = 0.113). These factors may be considered positively affecting the input-oriented ef- 
ficiency (EI). In the case of the mentioned factors there was also a positive correlation with re- 
gard to the output-oriented efficiency (EO). The dependence in this respect was, however, much 
poorer (7, = 0.1; p = 0.281 andr. = 0.09; p = 0.346). Wilcoxon’s test also demonstrated a strong 
relation between output control (C,) and the input-oriented and output-oriented efficiency (EI 
p <0.001; EO p = 0.002). This factor should be considered as one substantially affecting com- 
prehensive efficiency. 

The lower level of correlation and its negative direction occurred, on the other hand, in 
the case of the compliance of implemented tasks with the formal scope in the organizational 
unit (Co,) as well as the level of variability of implemented tasks (S,) and comprehensive effi- 
ciency (both inputs EI as well as outputs EO). These factors should be considered as lowering 
efficiency. Small positive correlation was also present between formal procedures of task im- 
plementation (S,) and the input-oriented efficiency (EI) (7, = 0.05; p = 0.601). With regard to 
the output-oriented efficiency (EO), this factor was related to negative correlation (7, = -0.06; 
p= 0.537). 
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In general, the higher level of correlation occurred between the criteria of organizational 
effectiveness related to New Public Management and comprehensive efficiency. The highest 
correlation (strong) in this case occurred between the output-oriented efficiency (EO) and own 
incomes of the commune (P,) (7, = 0.62; p = 0.000). A relatively high level of impact on the 
outputs (EO) was also demonstrated by investment expenses (P,) (7, = 0.29; p = 0.002). In the 
case of the listed factors there was also positive correlation with regard to the input-oriented 
efficiency (EI) (7, = 0.18; p = 0.050 and r, = 0.18; p = 0.049). These factors may be considered 
as contributing to the growth in the unit’s comprehensive efficiency. Negative correlation oc- 
curred between efficiency and the possibility to increase the scope of tasks at the present level 
of resources (O,). This means that the higher reserves indicated by the respondents, the lower 
the efficiency of units. 

The low level of correlation and compliance of the distribution of the analysed variables 
was also recorded between motivation focused on outputs and comprehensive efficiency. A 
negative correlation was recorded in the case of a connection between the bonus and the as- 
sessment of employee individual results (M,). As compared to the input-oriented efficiency 
(EI) it was on a moderate level (7, = -0.21; p = 0.079). With regard to the output-oriented ef- 
ficiency (EO), the correlation of this factor was insignificant (7, = -0.09; p = 0.440). A similar 
insignificant level of correlation was recorded between promoting employees on the basis of the 
assessment of individual results (M,) and the unit’s comprehensive efficiency (EI r, = 0.06; p = 
0.535; EO r,=-0.01; p = 0.939). It demonstrates the lack of impact or even a negative impact of 
using financial stimuli as well as promotions, focused on individual outputs, on the unit’s com- 
prehensive efficiency. The presented thesis confirms the results of previous research, described 
in literature, indicating the following extra-financial factors as the main sources of motivation 
in public sector units: stability of employment as well as implementation of tasks of particular 
significance (Houston, 2000; Buelens, den Van Broeck, 2007). 

In the case of the criteria of organizational effectiveness related to the concept of Public 
Governance, positive correlation on a moderate level was recorded between efficiency and 
the number of projects conducted as part of public-private partnership (Ec,) (El r, = 0.21; p = 
0.070; EO r= 0.16; p = 0.184) and the number of implemented innovations (I,) (EI r, = 0.34; p 
= 0.008; EO r= 0.29; p = 0.049). The listed factors should be considered as ones affecting the 
comprehensive efficiency of the examined communes to the greatest extent. 

On the other hand, civil participation in the examined communes does not contribute to 
the growth in the unit’s efficiency (EI p = 0.710; EO p = 0.485). 


Conclusions 


The research demonstrated the presence of dependences between the criteria of organi- 
zational effectiveness and efficiency. The strongest positive dependence with regard to efficien- 
cy was recorded in the case of expenses for training courses and other forms of supplementary 
education for employees, acquiring financial funds as well as investment projects, using output 
control and cooperation as part of public-private partnership and innovations. These factors 
should be considered as ones contributing to the growth in efficiency. Negative correlation, on 
the other hand, was recorded between factors related to stability and the formalization of activi- 
ties as well as using financial bonuses and other motivation stimuli related to the assessment of 
individual results. The research did not demonstrate dependences between civil participation 
and efficiency as well. These factors negatively affect the level of efficiency or they do not af- 
fect it at all. 

The conducted research not only made it possible to identify the impact of organizational 
effectiveness factors on efficiency in public sector units but also confirmed the need to jointly 
assess efficiency and organizational effectiveness. This is the only way to obtain wide knowl- 
edge on actual reasons for a specific level of overall effectiveness in public sector units. 
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